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ABS TRACT 


Bie flexibility and ease of programming on an Analog Computer 
provide a theoretical-cum-experimental approach for the solution of most 
of dynamical problems and at the same time it provides a real insight 
in'to the behaviour of the system under study. A simple, fast and 
accurate method for solving linear and nonlinear programming problems 
using an Analog Computer is described in detail. The programming problem 
is interpretted as the asymptotic solution of a problem in the dynamics of 
a massless particle which is assumed to move in an n-dimensional space, 
§.way from those regions prohibited by the constraints of the problem and 
toward optimization of the objective function. The constraints or the 
objective function may not be linear but merely expressible with available 
Analog Computer components. A number of linear and nonlinear programming 
problems have been solved on three TIi20 and the results compared with the 
solutions obtained using a digital computer. Post optimal analysis of 
these problems was also carried out. 
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CHAPTEl I 


1.1 Idnear and Non-linear programming is concerned with finding optimal 
solutions to the static problems that arise in many fields of science 
and industry. Ihe potential of an analog computer in solving such type 
of problems has often been overlooked partly because of the limited 
size of the problem that it can handle and partly because of limited 
accuracy. The size of the problem that can be solved on an Analog Computer 
is limited by the available number of computing amplifiers and the 
number of inputs to each amplifier. The latter difficulty is overcome 
by adding external equipment in the form of banks of coefficient 
potentiometers to the available Analog Computer TR-20. Regarding 
accuracy, however it must be borne in mind that a large number of 
industries employing optimization techniques are not able to provide 
problem data to the computer to an accuracy better than 1?^. The analog 
computer method described obtain precision and accuracy well within the 
limitation imposed by the programming model itself. 

A. Digital Computer solves a programming problem in a step by 
stop numerical calculation at discrete points whereas an Analog Computer 
will solve such a problem in a dynamic fashion eventhoi^h the problem itself 
is static. The advantage of solving a programming problem in a dynamic 
fashion is speed, since the solution point is calculated continuously 
rather than dis continuously point by point, and the resulting solution 
even for a large programming problem takes only a matter of seconds. 
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Moreover the operation of the Analog Computer provides a very 
valuable insight into the nature of optimum seeking problem and its 
behaviotir under varying parameters. 

1 .2 Outline of the thesis* 

Chapter II outlines the theoretical background for solving 
programming problems on Analog Computers . 

of 

Chapter III explains the method/solving LP (Linear Programming) 
problem on 'I'E-20 and the Design of external equipment to allow more number 
of inputs to each amplifier for medium sized LP problems. 

Chapter IV illustrates a few LP problems and a transportation 

problem solution, along with their post-optimal analysis using TR-20 

✓ 

with additional inputs. 

Chapter V explains the extension of analog computer method to 
nonlinear programming problems and illustrates some examples. 

Chapter VI outlines other type of problems that can be solved 
using the same technique on Analog Computer. 

Chapter VTI is the conclusion. 
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CHaHEER II 


THEOHEIICIL BA.GKGROUHD 

2 .1 Ihe general programming problem requires the evaliaation of a number 
of unkno-ms so as to maximize or minimize an objective function subject to 
various constjoaints in the form O/f equalities and inequalities among 
functions of those unknowns. Ihe programming problem may be expressed in 
the forms 

Sind Xj^ (i = 1 ,2 . . . . n ) to maximize 

Z(x) = c-| ii +02 ^2 + °n ^n (2 .1 ) 

subject to the constraints 


n 


■a . 


Z “.11 =^1 


1,2 


m 


- 1*1 


& x^ 0 i “ 1 ,2 . 


n 


(2 . 2 ) 


If the coefficients c-j , .... and a ,^2 • * • • 

a &b.,b„..... b are all constants, the resulting problem is 
a linear programming problem. Z and L may be arbitrary, single valued 

ti 

functions of x's. For the purpose of computation by the method to be 

described, the first derivative of Z(x) must be defined throughout the 

solution space and the first derivative of A. must be defined in the 

J 

nei^ibourhood of the solution space boundaries. Electronic Analog 
computers are built to handle relations between variables and their time 
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rate or change. It is therefore reqtiired to prescribe the time rate 
of change of each variable appropriately. This time variation is in 
a fictitious analog time, for the problem being solved is a static one 
with no time dependence. 


2.2 Ge ome tri cal Interpre ta ti c-n > 

In geometrical language, the are coordinates of particle Q 

dx * 

in £in n-dimensional space. The J- are components of velocity vector 

dt 

« 

Q of the particle. The method cf solution of programming problem on an 
analog computer is a variation of general method of steepest ascent 
(descent). The basic idea is to generate in the solution space a moving 
point Q, that travels along the gradient of objective function to be 
maximized (minimized) until the optimum point is reached, thereby ensxiring 
that the incremental changes in the solution displacement produce 
maximum change in the objective function. The velocity vector of the 
moving solution point can be defined by 
. El 

Q = sV Z -Ky ^ -Vi. (A - b ) (2.3) 

j=1 


where 



0 if A.^ h. 
j— a 


(2 .4) 


■V Z denote the gradient of the objective function 


Z (x^, 


. . . ) and is defined as 


n 


h Z 


grad Z ='S^Z = x^ i^ + ig + • • • • 


^ Z . 
"-a 
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vi-here , i2 » . . . are the xmit vectors of the cordinate 

sjstem along , x.p • • • • x respectively. Similarly X,' defined 

a vector normal to the honndary hypersxtrface A. = h .. 

J J 

s is an arbitrary real timber, which may be allowed to go to 
zero as the solution point is reached. 

K is an arbitrary large real number (may be 10 or 100). 

In. words the velocity of Q, is given as the velocity along the 

direction of the gradient of objective function minus the sum of 

velocities in the direction of decrease of each so long as constraint 

A. is not satisfied. The signs of equation (2.3) are reversed if it is 
J 

desired to minimize the objective function. Hence so long as the point 

Q (x-j , Xg .... x^) is inside the n dimensional space (i.e. all constraints 

satisfied) the velocity vector lies along the gradient wf the objective 

of 

function, thereby moving in the direction/steepest Ascent (Descent). As 

some of the constraints are violated at some finite distance beyond 

the buuadary, the value of A. - b. will be such that the term 

J J 

-kVa. (A.-b.) in equation (2.3) will just cancel the velocity component 

tj J 

normal to the boundary. After that the velocity vector will lie parallel 

to the hypersurface for finite positive value of (A.-b-). At points 
* u J 

in the neighbourhood of relative maxima (minima) of Z, Q will vanish. 

The value of constant s can then be made arbitrarily small, thereby 

reducing the quantity (A.-b.) and the point iidiere Q = 0 will be found 

J J 

in or at the boundary of the solution space. 
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2*3 !Ihe Jaxialos Set up t 

The essential elements cf inalog Computer needed to instrument 

the equations (2.3) and (2.4) arei 

/ \ dx • ' 

(a; Integrators for obtaining x. by integration of i 

dt 

(b) Summers to compute the ccnstraints 

(c) Decision elements to generate and to ensure that x. 
are 0 . !Ehe most convenient -way to perform this decision 
function is throu^ the use of diode limiting circuits. 


The general procedTrce then is to vo-ite the time rate of change 
of variables x^ as 


Xi 


= 8 


5 

d^'i 


m 


K 


Z 


lii 


1,2 • 


n 


where 


V (a. - b . ) j - 1 ,2 • 


in 


(2.5) 

(2.6) 


Bquaticns (2.5) and (2.6) represent the general programming problem set 
up. For equations (2.1) and (2.2) we can vrite 


m 


881-^2 Sjl <=3 


XX 

where e^ =■ a^^ x^; - b^ = 1 , 2 

i =1 


n 


m 


(2.7) 


(2.8) 


The resulting computer sot up for equations (2.7) and (2.8) 
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is shuiffli in Fig. 2.1. s is an arbitrary real number -sdaich may be alloised to 
go to zero as the solution is reached. Constant K is made large usually 
10 cr 100, In order that even a small error voltage of the order of few 
millivolts is fairly effective in keeping the solution point just near the 



Fig. 2.1* Computer Schematic for mathematical 
programming problem 


Hhe variables are integrated with respect to time from the 
starting point determined by the initial conditions x^(o), X 2 (o) . . . . 
x^(o). Ihe effect of error voltages , ^ 2 * * * * back is to 

concol the component of each x^ that is normal to the boundary hyper- 
surface, thereby constraining the point 0, to move in the direction of 
increasing Z(x) but parallel to the boundary surface. At this stage 
the point Q will lie a very small distance outside the allowed region 
for any finite value of s. For a finite value of s the velocity vector 
\7ill almys have a component along grad Z until maximum (minimum) value 
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of Z is reached, Ihe value of s can then be made zero to get the 

solution point. The diode connected across the integrator in Fig. 2.1 

ensures that the variables are alisays ^ 0 and the diode connected 

across the inverter sho-m in Fig. 2.1 is used to keep the output cf 

inverter as zero so' long as b.. Ihen quantity A. is larger 

than b-, a voltage appears at the output of the Summer. This voltage is 
J 

multiplied by a gain constant K and fed back through an appropriate 
coefficient potentiometer to the integrator of the variable associated 
with that constraint. In addition to the elements shoum, another summer 
is used to sum + C 2 ^2 + . . . . ^ objective 

function. 


2 .4 Analytic Ekplanationt 

The Analog Computer solution is based upon the property of an 
integrating amplifier that when the input voltage is made zero from a 
finite value, the output assxmes a constant value. For maximization 


are fed to n integrators respectively so that when Z (x^,X 2 . . . 
^ cl Z 


is driven to its maximum value, 




have become zero, consequently the 


integrators input is zero and their outputs, now constant represent the 
value of Xj^ (i «= 1 ,2 . . . n) which maximizes Z (x-j , X 2 . . . . x^^). 

The introduction of ccnstraints into the optimizaticn process 

is achieved by the use of error voltages e. (j==1,2. . .m) such that 

J 

e . is a large negative voltage if jth constraint 
j 
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A.=a.^x^+a.oXo + «** a. x^b. 
D a1 1 2 jn n-- j 


is not satisfied and 


is s ro if it is satisfied. The error voltage e , is applied tc the 

u 

appropriate integrator in the negative sense to decrease the value of 
bhoreby readjusting the maximization process to satisfy the jth 
constraint. liode feed back around the constraint amplifier allew 


either e , ca 0 (jth constraint satisfied) or e. = large negative voltage 


(jth constraint not satisfied). 

Tine error voltage must be factored 

before feeding to the appropriate 

x^ integrator according to the 

effect the has in 

generating the jth constraint i.e. 

for x.f e. is factored by a... Sie 
13 31 


-"j 

a.^ x^ 
^j2 ^2 


a,.„ x^- 


R 

R i 

_/rv • 

R 

! 

.’,R. ' ^ 




Pig. 2.2* Error voltages e. 

— K — 3 


d X, 


con''ition x. >' 0 is ensured simply by v, 

X — 

diode feed back aromd x. integrator ^ 

1 ®22^2' '■ 


as shoirn in Pig. 2. 5 < 


E 

- . . \ 'A 

E 

_ 

R 


R 


V- 


^i 


a .Eb ■ 
mi m 


Pig. 2. 3 j x^ Integrator with 
oonstrant x^ ^ 0 


2.5 discussion* 

It may not be possible to determine in advance whether 
a f'.iven programming problem has a solution or whether its solution is 
unique. I&der these circumstances analog computer proves to be a 
handy exploratory tool. Any region of interest can b©' sufficiently 
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scanned by observing the solution with different sets of initial 
conditions thereby arriving at the desired solution. Scanning becomes 
necessary if solution point does not settle down to a point where all 
the constraints are satisfied. In case the solution point diverges 
toaard infinity, the solution space is not alosed in the direction - of 
increasing values of the objective function, implying an improper 
programming problem. 

2 ,5.1 LP Problems t 

The method described in 2.3 works very well for LP problems 
since there is only one maximum (minimum) in the solution space. The 
solution will be obtained on the first trial starting from any initial 
point within a matter of seconds. The time being proportional to the 
value of s. All the functicns appearing in LP problems are sums of 
constants or constant multiples of variables. Therefore an LP problem 
always leads to a connected convex set which will have only one point 
within the solution space (defined by the constraints ) at which the 
objective function has maximum (minimum) value. 

2.5*2 Nonlinear PrOigrammina Problems* 

Nonlinear programming problems present two major difficulties 

(a) Describing the nonlinearities mathematically and taking these 
nonlinear functions into account during the set up. %ls 
presents no problem on Analog Computer because a non-linear 
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ftmction is treated in the same manner as a linear function. 
However expressing nonlinear function on .Analog Computer does 
require more elaborate equipment. 

(b) Ifelike LP problem, a nonlinear programming problem may have 
a number of local optimum points. This will warrant the 
scanning of the solution space by using different sets of 
initial conditions for each trial . Since a very large number 
of tnials can be carried out in a relatively short time, this 
results in a good probability of finding the coinrect solution. 

2.5*3 Sensitivity itoialysist 

It is quite easy to change the coefficients in the objective 
function, the coefficients in the constraints or the constraints them- 
selves, merely by resetting the appropriate potentiometers. Therefore 
one can very conveniently explore the sensitivity of the problem as a 
function of parameters of the system and/or find the effect on the 
system of changes predicted in future. However the use of Analog 
Computer has the disadvantage that large problems require a large 
aimmtof Analog equipment and obtainable accuracy decreases with increase 
in size of the problem. 
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CHikPTER III 


5.1 ii' simple example will illustrate the isnalcj; method of solving 
hP problem* 

Ebcamule 1 * 

Maximize Z = Jx^ + 5^2 (5 •'1 ) 

subject to the constraints 


•: r 4 

^2 6 

5x^ + 2 X 2 5$ 18 

5 X 2 ^ 0 


(5.2) 


■Applying the method outlined in Chapter II the following tine 
rates of change of two variables defined within the solution space are 
obtained* 

5T“ “ 

3^2 

Ihe solution space is bounded by five lines (see Pig. 3*1 ). If 
the solution point velocity vector is defined as above, the point will 
move along the path shown in dashed line until the first boundaiy is 




3s 


’^X2 


5s 


(3 .5) 


* Hillier, P.S. , G.J. Lieberman ’’Introduction to 'operation Research” pp.139 
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CHAHERIII 


5*1 ii' simple example will illustrate the i^aleg method of solTiug 
LP problem* 


Example 1* 


Maximize Z = + 5^2 

subject to the constraints 

r 4 

X2 6 

5x^ + 2 x 2 5$ 18 

x^ 0 5 Xg ^ 0 


( 5 . 1 ) 


( 3 - 2 ) 


Applying the method outlined in Chapter II the following time 
rates of change of two variables defined within the solution space are 
obtained* 


^ ^1 <^Z 

' *3 <3 

<3 1 

S ^2 2)z 

** 


5s 


5s 


(3 .3) 


Ihe solution space is bounded by five lines (see Pig. 3 . 1 ). If 
the solution point velocity vector is defined as above, the point will 
move along the path shown in dashed line until the first boundary is 


* Hillier, P.S,, G.J. Lieberman "Introduction to .operation Research" pp.139 
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reached. If the component of the velocity vector perpendicular to 
is then removed by feed back circuits the point ■will continue to 
mo-ve along in the direction of increasing Z. ^.hen next constraint A^ 
is reached, the solution point will cease to move and if new the value oj 
s is allowed to approach zero the solution point will stop at 'the 
intersection of two constraints A2 and A^, giving the solution as Z=36. 

3*1*1 Scaling t 

It is obvious from equations (3.1) and (5*2 ) that scaling must 
be done first. 3 h programming problems it is advisable to select scale 
factor for each variable to obtain the desired accuracy. 


let p^ (i = 1,2 . . . n) be the scaling factor for each 
(i = 1 ,2 . . . . n) respectively . llien 


Xi 

y. = and substituting it in equations (5.2) 

1 Pi 


we got 


P^y^ 4 

P2y2 6 

3 P-]yi + 2p2y2 .r- 18 


(5.4) 


However it is obvious from equations (3.2) that x^ and Xg can 
at the most be equal to 4 and 6 respectively, therefore ■their scaling 
factor p^ and Pg should be 4 Shd 6 respectively. Allo^wing for some 
overshoot, devide each ineq'uality of (3-4) by such a constant that makes 
each element of the BHS as less than or eq^ual to 1 , Iherefoire, dividing 
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oquati'jns srl. 1,2 and 5 of (5.4) by 5 » 1 ^ snd 20 respectively, 
we got 

^1 

"~5“ <- 0.8 

P2 

“ 3^2 (5. 

3 Pi 2 p^ 

20 3^1 ■*■ “'20 3^2 ^ 

How select the scale factors p^ , and such that all the 
constant elements of the constraints are less than or equal to 1 . 

Selecting = 5 Pg “ 8 

and siting (5.5) in the table (3.1) 


* Constraint , 

¥0. j 

! 

Variables A 0 . . I 

,, y Specification 

Z 5 Z 5 I 

) 8 } I 

1 

1 -f: 0.8 I 


0.8 S- 0.6 ! 

i 

t 5 

j 

V 

0.75 0.8 0.9 I 

t 

Table 5*1 * 

Scaled coefficients of example 1 


Now writing the objective fmctiun in terms cf y^ 

z *=* 15 y-[ 4^ 72 

2 “ -|q •= 0 . 3 y^ + 0.8 yg (3,6) 
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3*1 "2 inalog Solution ? 

5 he analog computer circuit necessary to instrument table 
(3.1) and equation (3-6) is showi in Fig. (3.2) . 

Ihe error voltages are set up from table 3*1 are shoTstn in 
Fig. 3. 2(b). Generation of and J2 ds indicated in Fig, 3. 2 (a). Fot . 
(Potentiometer) settings of the scaled problem are indicated in the 
Pig. 3*2 itself. Setting of pot s is initially unity. Germanium diodes 
■mere used. In the event of "constraint being satisfied", the error voltag 
■were found to be small positive values of the order of. 0.1 vol-ts or so 
instead of being zero, Uierefore intermediate diodes D4> ^5 and 1)6 -were 
added to achieve zero error voltage. Ihe folio-wing procedure results 
in better accuracy than obtainable otherwise. 

3 * 1*3 Operating procedure* 

1. ihtch up the various -bested components of TE-20 as per the 
scaled diagram of the problem . 

2. Set the various pots to -the desired value, keeping the setting 
of pot s to uni-by. Pot setting of the external coefficient pots is done 
as per 3*4 s^d s-witch the computer from ’Beset ^ to 'operate*. 

3. Allow 2-3 seconds to enable the outputs of various integrator/ 
amplifiers to attain steady state -value . 

4. Check the -values of constraint amplifiers 3»7 ^^d 8. For -tVe 
error voltages make the corresponding factor K as 1 instead of 10. For 
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-ve error voltages short circxiit the corresponding intermediate diode 
and keep K=1 0. 

5- Reduce the setting of the pot s from unity to zero. Repeat steps 

3 « 4 if found necessary. 

Tlie results obtained for example 1 are 

x^ = .401 X 5 = 2.005 error = — x 100 = .259^ 

x^ = .749 X 8 = 5*992 error = ■ x 100 = .139^ 

z = .72x50 = 56 


5Che above procedure ensures that all the constraints are being full 
satisfied and the results obtained are fairly accurate. 


3 .2 Additional aids to computation* 

1. For minimizing instead of maximizing an objective function ^ apply 

'^Z' . c)Z’' 

instead of -- — to the y. integrator. 

c) y p c) 

2. To interchange the restricted and allowed region for any constraint 
edge, reverse the diode connected across the corresponding constraint amplifis 

3. Negative coefficients among the constraints must be treated by the 
introduction of an inverter in the corresponding path since each such 
coefficient enters the wiring diagram twice. Tijo inverters are required 
for each negative term. 


4.. Negative coefficients in the objective function are handled by the 

R'j 2 ' ^ Z ' 

application of n — instead of at the appropriate integrator input. 

dyj[^ <j y^ 


5. To incorporate equality constiraint instead of inequality constraint, 


remove the diode connected around the appropriate constraint amplifier. 
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6. If the integrating capacitors are all started from a discharged 
condition, the solution point will start its motion from the origin. For 
scanning purposes it may he desired to start the solution point from another 
initial condition. This is achieved hy introducing appropriate initial 
voltages on the integrating capcitors , 

5 *5 limita tio ns of inalog Computer* 

The main limitations in the use of Analog Cmputer for programming 
problems are s 

1 . Size of the problem is restricted by the available number of amplifier 
and potentiometers and the nmber of inputs to each amplifier. 

2. Hae accuracy decreases with the increase in size of the problem. 

The nmber of amplifiers required for any IP problem are 
= n + 2m + p+2 out of which n are integrators 
where n = Number of variables in the problem 

m = Number of constraints in the problem 

p = Number of rows plus columns containing ‘negative coefficients 
in the LHS of constraints . 

One amplifier is required to generate the objective fxmction and another 

is required in generating — . 

dJi 

Number of potentiometers required for solving IP problem are 
2g + 2h + m + 1 

where g = Total non zero coefficients on the IHS of the scaled 
constraints . 

h = Number of non zero coefficients in the scaled objective 
function. 
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m = NumlDer of scaled non zero EHS elements in the constraints. 
Number of diodes required for solving hP problem are = n+2 x m 
■where n = N-umber of variables in the problem. 

m = Number of inequality constraints in the problem. 


bse of three TR-20 inalog computers provide 60 amplifiers (24 
integrators) and 72 potentiometers. However, the main limitation comes from 
the limited n'umber of inputs a’vailable to each amplifier. Since there are 
only two inputs of gain 1 and two inputs of gain 10 to each amplifier. It 
is obvious from the discussion so far that each constraint amplifier requires 
as many inputs of gain unity as there are number of coefficients in that 
constraint including HHS elements, which, for example may be 10 for a nine 
variable problem. Also each integrator requires as many inputs of gain 10 
as number of coefficients in each column of set of constraints excluding 
EHS vector. It therefore warrants the design of an external equipment in the 
form of variable banks of extra inputs of gain 1 and gain 10 along with additic 
potentiometers to supplement ihe potential of the three TR 20 Analog Computers. 


5 .4 of External Equipment for additional inputs to TR-20 i 

Ihe inputs resistors used in TR-20 are fixed Resistor, wire wound, 

precision type, + .05^ and of -the values shown in Pig, 5.5* The resistor 

-'v'nA- OOK 

selected for the external equipment 100K 


are 10K and 100K, + 1%, :Jw, metal film 
resistors v/hich are highly stable. 

Only the resistors within + .25^ -variation 
Tjere selected for the purpose, To ease out 


®1 

E 

7 

e) 


10K 

-''Ws— 




S 




Eig.5-5' Input Eesisters with 
each amplifier 
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the problem of additional pots, a 5*5^ potentiometer was connected in 
series with each ')0'K/^00K input resistor for various coefficient settings. 
Ihe potentiometers used are single turn, metal film type which give 

fairly stable settings. The set up for this equipment is shown in Pig. 5 •4* 
The shaded circles represent the sockets for external connections. Suppose 
it is desired to add three additional inputs to any amplifier, the following 
procedure should be adopted in order to take into account the effect of 
loading and for accurate setting of external pots . 


1. Interconnect the "To SJ” terminals of three rows (say and A^) 

by jumper wares as shown in Pig. 5 .4* 

2. Connect one of these "To SJ" terminals to the accessible SJ terminal 
of the amplifier whose number of inputs are required to be supplemented. 

5 . Peed -10 V at input terminal of and set the corresponding pot 
to the desired value by null method so that the output of the amplifier in 
question is same as desired pot setting. Remove -107 from input terminal of A, 

4 . Repeat step 5 for and A^. 

5 . Connect the desired inputs to input terminals of A^ , A^ and A^. 


Two external boards of the type sho7n in Pig. 3*4 were constructed 
and fitted on top of two TR'20, thereby giving a total of 3 O additional inputs 
of gain 1 and J)0 additional inputs of gain 10, In addition 60 additional pots 
were also incorporated giving total number of available potentiometers for 
programming as 72 + 60 = I52. It is felt that this external equipment has 
greatly enhanced the capability of existing TE-20 Analog Computer in solving 
Linear and nonlinear programming problems. 










10CK 

v//^- 


100 K 
~A/'\/'\A.\ 


"iook''!: 


VvVv - Q -i. 


Or.T 
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CHAPTER lY 

LP EXAMPLES ¥ 1 TH THEIR FOST«.OPTIMAL ANALYSIS 

4.1 Pntroduction? 

Cnee an LP problem of practical interest has been solved, 
situations may arise iPhLth require additional computation. 

With practical problems we are often interested in not only the 
optimal solution of the given problem but also desire to know the effect of 
parameter changes on the solution, such as the profits (cj^) or the elements 
of requirement vector (b . ) or the elements of constraint vector (a..). In 
certain cases, after solving the problem, it may be discuvered that one esc 
more of the profits were incorrect, one or more of b. were wrong or perhaps 
a decimal point was misplaced in some of the a. . etc. etc. In Analog cemputer 
method the above problem can be overcome simply by solving the problem with 
revised pot settings, We will now consider in detail some typical LP 
problems bringing out the scaling procediore and post-optimal analysis as 
explained above. 

4.2 Example 1 t 

This example is the modified version of a LP problem* involving 
6 variables and 8 constraints. This modification was done to fully utilize 
the two TR- 20 ’s and the external boards for additional inputs. The example 
given below involves 8 variables in 12 constraints. 

Maximize Z = 8x^ + 6x2 + 1 Cbc^ + 8x^ + * 4 xg + 8 xj + 6xg (4.I ) 

*Hillier, P.S., G.S, Lieberman, "Introduction to Operation Research, PP.55I 
Ex. 


23 


Subject tos 


X2 + Xj + 

X4 + X5 + Xg 

2 .5x^ + 2 x 2 + x^ +^*’5'Xg. 

x^ + 5^2 • 

i- Xj + X^ 

2 x^ + X 2 ■ 

*■ 4x5 + Xg 

+ x^ + 

^6 

2 x^ + 2 x^ 

+ 5 Xg 

x^ + x^ + 

X4 

^4 + + 

^6 

3xg + 

+ 4 Xg 

3 x 2 + 4 x 4 

+ X6 

4xj + 3x^ 

tx^ 

5x^ + Xj 






25 

55 

15 

15 

15 

20 

10 

5 

15 

10 

20 


35 


( 4 * 2 ) 


and ^ 0 for i = 1 ,2 . . . . 6 

4*2.1 Scaling:? Because of the uniformity in the magnitude of the elements 

of various vectors, the scaling iu simplified considerably. Dividing constra'in 

( 4 . 2 ) by 10 and noimalizing all variables to one maximum value = 5 such that 
- 

y. = ^ for i = 1 , 2 ... 8 . Bhe scaled problem constraints are tabulated 

5 

in table 4*1 • 


Ifciting objective function Z in terms of y^ and dividing it by 200, -we get 
^ = Z* = .2y^ + .iSy^ + .25yj + .2y^ + .I25y^ + .lyg + .2y^ + .I5yg 

(4.3) 
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Table 4*’I* Coefficients of the scaled constraints 
for example 2 


4.2.2 Analog Solntioni 

The analog computer diagram with the pot. settings is shorn in , 
Appendix ’A’. For this problem two TR~ 20 's and 55 axtemal inputs xrere 
utilized. The problem utilized the folloTring analog computer components 
(refer to 5* 5)* 

(a) Amplifiers = 8 + 2x12 + 2 = 34 (S integrators) 
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(b) Potentiometers = 2 x 40 + 2 x 8 + 12+1 = 109 

(c) Diodes = 8 + 2 x 12 = 52 

Dsing the procedure outlined in 5 *"!» 5 i "fch® soluticaa obtained is 
tabulated in table 4 * 2 . same problem was also solved on IBM 7O44 

using DP package, the results of Tdiich are also tabulated in table 4*2 
for comparison sake. 


i Variables 

1 

i 

I Scaled 
solution 

I inalog 

^ solution 


■ 

Error 

j ^1 

CM 

00 

• 

4.12 

4.1704 


1.25^ 


. .405 

2.025 

2.0000 


1 .23<fo 

I X:, 

! 5 

.978 

4*89 

4.8295 


1.24^ 

"4 

.203 

1.015 

1.0000 


I.55S 

I 

f 

i ^5 

.047 

.235 

0.2272 


3.42?^ 

i ^6 

0 

0 

0 



i 

X 

I 7 

0 

0 

0 


- 

!i 

|i ^8 

.76 

3.8 

3.7500 


1.53/“ 

jl Z 

.65 

126 

125.295 


0.56?^ 


Table 4 * 2 * Comparison of Malog and Digital solutions 
for example 2 


Error colxmin in Table 4*2 represents the deviation of analog solution 

from digital solution expressed as percentage of the digital solution. 

It is seen that the error in Xr is more pronounced than the other variables. 

5 

This is attributed to the small magnitude of scaled solution. The accuracy 
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can be improved by using a smaller scaling factor for 
4.2.5 Post optimal Analysis t 

The effect of variation of 5 HS elements (Eosources available) 
on the objective function was studied at discrete points. One element 
of the EHS vector (b.) was varied at a time with the help of caliberated 

ti 

potentiometer and the corresponding value of the objective function 

recorded. The values of the variables (x^ , X2 • • • Xg) were observed 

simultaneously and any changes from the basic feasible solution recorded. 

Table 4*5 gives the effect of variation of b. on objective function. The 

J 

corresponding curves are plotted in Fig. 4,1 (a) and (b). Consider the 
variation of bj and its effect on objective function from table 4.5 and 
Pig. 4.1 (a). For b^ ■=< I5, Z «= 126 i.e. optimum solution. This is 
represented by point A in Fig. 4.1(a). As b^ is decreased from 15 » Z also 
decreases and when Z = 112 , variable X2 which was previously in the 
solution basis becomes zero» and remains so subsequently. This is indicate 
in the remarks clumn of table 4 » 3 « A further decrease in b^ reduces the vali 
of objective function and other variables in the basis. If however after 
obtaining the optimum solution with given constraints, b^ is increased 
from 15, Z also increases thereby indicating the room for fxirther 
improvement in the objective function. It can be seen that Z can be 
improved only by Increasing b^ , b^, b^, b-jQ or b^^ . This was confirmed 
from the subroutine ”BHS ranges” of the LF package. This subroutine gives 
only the upper and lower limit for each b. so that the solution basis 

ti 

do not change. It is clear that the post optimal analysis on Analog 








marks hh 
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Table 4*5* Record of the effect of variation of b. on ob.iectlve function (z) 
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computer provides verj'' valuable information easily whereas extensive 
digital computer programming will be required to achieve the same results. 

4.5 Sgamnle 

Ihis problem is the simplified version of an LP problem from a 
thesis work*. The size of the problem was cut down because the available 
number of analog computer components were not sufficient in number to solve 
it. This example involves 9 variables in I 4 constraints. Ifelike the last 
example where all the variables were scaled by -ttie same factor^ different 
sealing factors are chosen for different variables to-rgiv® better accuracy. 
Maximize 

Z - 9.5 + 12 X 2 +5*5 + 2x^ +5xg + Bxj +1Qxq+5.5x^ ( 4 . 4 ) 

Subject to! 

Multiplying factor i 


1/3 ! 

x^ + 

X2 +X5 


2.75 

1 I 

X + 

^4 

X5 +Xg 


.85 

1 i 

< 

Xg + 

^4 

— 

.75 

1/5 I 

X-J + 

X5 +X5 


2.2 

1 

x? + 

^8 


.75 

1/2 i 

x^ 



1-5 

1/5 i 

•4X5 

+ . 7 x^+. 7 xg 


2.3 

1/2 

• 4 x-j 

+ .25xg+6.5xg 


1 .25 


* laj. A.V. Rao, "Algorithms for LP solutions for varying model 
Parameters”, Thesis B.E., IIT-Eanpur. 
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HuItiplyirLie: factor 

1/2 

1/10 

1/10 

1/10 

1/5 

1/2 


. 25 Xy+ 2 . 2 Xg+. 1 xg 1.2 

.8x^-^2x.^ -+2.5x0 -“-j 8,5 

.5x^+.5Xj+.53Cy+.5x^ :^Sr 8.5 

1 .2x^+1 .5x^+1 .5x^-H .7x0 8.5 

1 . 3x^ +. 1 5x4 +. 1 5x0-+- . 9x^+. 5x^ 2 .5 

.2x2+6xg ^ 2 

«& x^--7 0 for i ■= 1 ,2 . . . 9 


(4.5) 


4»5»1 Scaling i We \vrite y. = — ^ and multiply each constraint 

% 

in (4*5) l*y such a constant so that each element in the EHS vector is 
less than or equal to mity. Oie values of the constants are indicated 
in the "multiplying fact«3r" column shown in (4.5)» Room set of oonsticaints 
(4.6)jSeloct constants p^ (i = 1 ,2 ...9) corresponding to each y^(i=1 ,2. ..9) 
in such a way that all the LHS constraint elements of (4*6) are less than 
or equal to unity. 


It can be visualized that non uniform scaling of the -variables 
becomes qtdte involved, since all the constraints have to be checked for 
each p^. It is therefore felt that, initially, all the variables should 
be scaled by the same constant and solution obtained on the analog computer. 
Ihe solution itself shall warrant the rescaling of some of the variables 
which can be accomplished easily. 
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£1 ^2 

4. 4. ...J y^ 

< .9167 

^4 ^4 * ^’5 ^5 ■" *>6 ^6 

.85 

Sa ^2 + P 4 ^4 

--- .75 

1^5 P, 

— y ^ + — y, + 5^5 

cr' •733 

P7 + Pg yg 

.75 


2 3^9 


•75 

+-a. ,i!6 

3 ’^3 * 3 ^4 '^T~^6 


.767 

■4Pi .25P5 fi.SPg 

2 ^1 ■*” “T^ ^6 2 ^8 


•625 

-25p 2.2pg .1p 

2 y? * 2 ^e + 2 y? 


.6 

,^-5P8 

10 10 ■y‘7 10 ^8 


.85 

•3P-| •5P^ •5P'jr •5P9 

10 -^1 * 10 •''5 ' 10 ■^7 ' 10 ^9 

5’-- 

.85 

1.2p^ 1.5P^ 1.5P^ i.7p^ 

10 ^1' 10 ^3' lb •>'4' 10 ^6 


.85 

f.5p^ .I5P4 .15P6 .9 iw .3Pq 

5 5 ^4^ 5 ^^6^ 5 ^ 5 ^9 


.5 

♦2p2 ^^8 

■~2^2 ~ ^8 


1 

Selecting ■“ 3 



% “ P4 = P5 =■ P6 = » 1 




Ps “ 1/4 P9 “ 2 


(4.6) 


« 1 


(4*7 
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IJhe scaled canstraints are written in liable 4.4* 


Constraint ' 

5 Variables i 

J 

Ho. ( 

yi 

72 75 

74 75 

^6 

7 j 

=^8 

79 

jl Specification 

1 

1 

.355 1 






^ .9-167 

2 



1 1 

1 




< .85 

5 


1 

1 





< *75 

4 

1 

1 

.553 





^ *755 

5 





1 

-85 


.75 

6 







1 

.75 

7 


•4 

.255 

■ Z 35 




< .767 

8 




.125 


.8125 

i 

<r .625 

9 





.125 

.275 

.1 

.6 

i 

i 10 

.24 




.2 

.0625 


i *85 

j 

I 11 

I 

I 

.09 

.15 



.05 


.1 

' < .85 

> 

{ 

i 

12 

.56 

.45 

.15 

.17 




i 

. ^ *85 

15 

.78 


.05 

.07 

.16 


.12 

i - *5 

14 

i 

I 

! 

.3 




.75 


1 

I 

! 

1 


Table 4.4* Coefficients of the scaled constraints for example 5 . 

The objective function Z is written in terms of and 
dividing it by 50* 


^ « z'= . 57 y^ +'.2472 *5575 + .574 + .0475 *‘'^6 •''^^7 

.0570 + *1479 


(4.8) 





35 


4»3*2 iknalog Solutions Big ijialog Comp-uter set up diagram alongwith 
with pot. Settings for table 4*4 equation 4*8 is shoim in appendix 'B* 
Ihe problem utilized the following components (para 5*3 refers) 

(a) iimplifiers = 9 + 2x14+2 = 39 

(b) Bots = 2x40+2x9+14+1= 113 

(c) Diodes = 9+2x14 = 57 

Using the procedure outlined in 3.1'3» Analog computer 
solution was obtained and is tabulated in table 4»5* same problem was 

sol-ved on IBM 7044 using LB package, the results of which are also tabulated 
in table 4*5 loi' comparison sake. Ihe maximum error is about 3^ in xg. 
Bercentage error column represents the deviation of digital solution 
Gxoressed as percentage of the digital solution. 



Table 4*5* Cemparison of Analog and Digital aclution for example 3* 
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4 » 3»5 Post-optimal Jux&lysxst In example 2, the effect of 
variation of BHS elements on objective function was studied. Here 
the effect of variation of the profit vector on the objective function 
will be studied at discrete points for this problem. One element of 
of profit vector was varied at a time with the help of calibrated 
potentiometer and the corresponding values of the objective function 
recorded in table 4*6. Ihe values of the variables (x^ , . . were 
observed simultaneously and changes from the basic feasible solution 
recorded in the remarks column of table 4*6. Hie corresponding curves 
are plotted in fig. 4. 2 (a) & (b). 

Consider the effect of variation of c^ on objective function 
from, table 4.6 and fig. 4. 2. For =2, Z =40.^5 ih the optimum solution. 
Ihis is represented by point A in fig.4.2(a), As is decreased from 2 
to zero, Z is not affected. As is increased from 2 to still Z 
remains 46.5- Hiis is quito^ obvious since x^ = 0 in the above range. 
Iioviever at c^ = 5 j enters the solution bas-ls thereby resulting in 
increase in the value of the objective function. 

Careful sti dy of fig. 4. 2 will give a valuable insight in the 
behaviour of the variation of objective function, as profit elements 
(c^) are changed and one can select most profitable stregegy if some 
of the c^ are to be varied. For example decrease in the value of c^ from 
15 to zero results in reducing the value of the objective function 
merely from 40*5 io 59 . 6 . 








39.2 0 55.53 0 59.43 



objective function (z) 
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1-*4 ^x-^'niple 4 * This is a "blending problem, the type of which occurs 

quite often in the petroletua industry, A refinery produces three grades 

of Aviation gasoline and automobile gasoline by blending four components 

(refinery streams) which are available in limited amount per day. There 

avitifcfn 

are two quality specifications for each /product. 

(a) An upper limit on the admissible vapour pressure. 

(b) A lower limit on the octane rating. 


These two characteristics, which are measures of the volatality 
and the ignition properties of gasoline respectively, can be assumed to 
blend linearly, x. . represent the amount of product j in barrels per day 
produced from the constituent i. The problem is to determine the optimal 
values of 16 unknowns x. . subject to 10 restrictions, that can be derived 
from the data, namely, four material balances for the respective ingradients 
and two quality balances for each of three grades of aviation gasoline , 

Thus the C'bjective function is to maximize. 


Z = 5 (x^^ + X2^-bc5^'bc^^ ) + 5-5 (x.,2 + ^22 + X52 ^ ^ 42 '^ 

+ 6 (x^^ + X25 + + 4.5 + X24 + + x^^) 


(4.9) 


*Sven Dano, "Linear Programming in Industry", pp. 45-46. 
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Subject to the following constraints! 


^11 

+ X 

12 ^^13 

■""'14 



sr 

3800 



X21 

+ X 

22 ^ ^23 

*^4 



= 

2650 



X31 

4- X 

32 ^ ^35 




= 

4 080 



^41 

+ X 

42 "^43 




= 

1300 



I4x 

11 ^ 

5^2., - I 


153:41 


V 0 



Z.Ox^^ 

- 1.0x2^ 

+ 5.|Six 

31 

- 

13 

•5'^41 


0 

16.; 

5x^2 

+ 2x22 

- 4X32 

+ 

17x 

■42 



0 

2.0 

42 

- 1 .0.^22 

+ 5.0X 

52 

- 

13 

•5^42 


0 

7.51115 

- 7^23 - 

23x33 

+ I 

Sx 

43 


> 

0 

Z.Q>c^3 

— 1 *0X23 

+ 5.0k 

33 

- 

13 

•’&43 


0 


>0 

for i = 

1 ,2.. 4 

& 

a 

s= 

1 ,2. . 

4 



(4. 10) 


Ihe EHS elements of first four constraints of (4.10) represent 
the ainotuat offbur constituents available in number of barrels per day. 

4 « 4 *'l Scaling ° Dividing constraints Sri. 5 to 10 of (4.IO) by 25 and 
wilting yy . ^^for t - 1,2, 5, 4 

& j = 1,2, 5, 4 

The scaled constraints are tabulated in table 4*7* 


Writing the objective function Z in terms of y. . and scaling. 


vre get 


Z 


5000x20 


= 7' 


Z' = •25Gr-,.|-^y-,2ty-j3-+y-|4)+*275(y2^-<y22'^25'^24^ 

+ •5G-5-,-^52'^55"^54^ ^ 


(4-11) 
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4.4*2 Analog Solution^ Ihe Analog Computer set up diagram for table 

4.7 aii'i equations ( 4 . 1 1 ) along with the pot. settings is shown in Appendix 'C*. 
The problem utilizes the following components (Refer to para 5*3)* 

(a) Amplifiers = 16+2x10-1-2 =38 

(b) Pots = 2x24+2x16+4+1 = 85 

(c) Diodes =12+16 =28 

Using the procediu?e outlined in 3 •'13 the solution tabulated in table 

4.8 Tjiras obtained. The same problem was solved on IBM 7 O 44 lising DP package, 
the results of which are also tabulated in table 4*S* comparison sake. 

It is seen that 7° error in x^^ and x^^ is considerable. 


IHH 

Scaled 

Analog 

solution 

_ 

Digital 

solution 

I Percentage 
^ error 

.0 

X11 

0 

0 

0 


X12 

0 

0 

0 


^13 

0 

0 

0 

- 


0 

0 

0 


14 





^21 

.005 

25 

34.57 

27.7 


0 

0 

0 


22 





^23 

.591 

2955 

2958.73 

.127 

^24 

.134 

670 

662.62 

1 .12 


.756 

5780 

3765-43 

.39 

^32 

.556 

2680 

2650 

1.15 

^33 

,221 

1105 

1121.26 

1.45 

b4 

.128 

640 

610.714 

4.8 

X,M 

0 

0 

0 


41 






0 

0 

0 


42 





X ^ -v 

0 

0 

0 

— 

43 





"^44 

.0045 

22 

26.67 

17.5 

Z 

.693 

69300 

69112 

.272 


Table 54 * 8 * Comparison of Analog & Digital solution for example 4 
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The optimal values of x^-j & are 34*57 & 26.67 respectively 
and the scaling factor of 5OOO used in scaling these variables is too 
large comparatively. This has resulted in very small scaled values of 
these vai-iables and small error of the order of .001 in the scaled solution 
of these variables ■will reflect a larger percentage error. It is obvious 
that if the scaling factor for & x^^ could be made 100, the accuracy 
in the results of these variables will improve. However, the study of 
table 4*7 indicate that the scale factor for X2-j & x ^^ can at the most be 
reduced to 1000 and 25OO respectively, without affecting the accuracy of 
other variables adversely. Therefore the accuracy for these variables could 
not be achieved better than 1C^ or so. 

4*5 Ibcample 3* (Trans porta tinn problem) j One of 1h.e commonest application 
of Linear Rrogramming is the transportation problem. Here it is required 
to arrange the flow of goods from say, a number of warehouses to the firm 
customers. The system cnstraints arise from the customer demand and 
availability of goods at each mrehouse. The function to be minimized is 
the total transportation cost. A problem ■v'dth three origions and seven 
destinations xras studied using three TE -20 Analog Computers. Table 4*9 
gives the transportation cost matrix (Eupees/Ton), the availability at 
three origins (Tons/day) and the demands (Tons/day) at seven destinations. 
The demand at each destination m’ust be met. 


*Hadley, G., "Linear jProgramming" pp.524, Id‘Ob. 9 . 17 * 
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Origins 




Destinations 

, . . 

J Total availability 

ri 

^2 

""3 

B 

4 


;=’6 

“7 

^ i. Ullb / u.cl^ 

- 

°1 

10 

8 

16 

3 

10 

25 

18 

: 

10000 

°2 

19 

25 

18 

7 

12 

18 

19 

5000 

'■ o,-| 

I 

20 

I 

17 

20 • 

5 

14 

I 

16 

1 

17 

i 

10000 

Total dem- 
and 

Tons/Hay 

I 

j 

2000 

1000 

3000 

4500 

U1 

0 

0 

600 

1 

950 



Table 4 * 9 * Transportation cost matrix (itapees/Ton), 

Availability (Tons/day) and demands (Tons/Hay). 


This problem can be expressed as the following linear programming 


problem. 

Minimize Z = "*■ ^^12 

+ 19x2-1 ^ 5^22 "^^24 "^^^27 

+ 2Qx^^ + 17 x ^2 2^55 + 5 xg^ + 14x55 + 16x5^ + 17x5.^ 


Subject to the constraints 

^11 "''^12 "^^15 '*’^14 '*’^15 "^^16 *^’^17 
^21 ^22 ^25 ^24 ^25 ^26 ^27 

X51 + ^52 ^35 ^34 '*’ ^35 ^36 ^37 

X11 +X2., +X5^ 

^12 ^22 ^32 

^13 ^23 ^53 


^ 1 occo 

sir 5 *^°^ 

1 0000 
= 2000 
= 1000 
= 3000 


(4-12) 
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^14 ^24 ^54 

^15 ^25 ^55 

^16 -^^26 +^36 


X- . 45^ 0 for i 

4- J 


= 1,2,5 & j = 1,2, 7. 


= 4500 
= 500 

= 600 
= 950 


(4.15) 


4.5*1 Pealing: This problem has 21 (3x7) variables and 10 (5+7) 

constraints. It is clear that the size of transportation problem, that 
can be solved on Analog Computer, is limited by the available number of 
integrators, which is only 24 for three TR-20 (s integrators each). Ho^fever^ 
setting up of transportation problem is much less involved because of the 
unity coefficients in the IHS of constraints . This elliminates the patching 
and the setting up of number of pots , thereby saving considerable amount 
of time and effort. In this problem, to reduce the scaling factor to 
5OOO first and third constraints in (4.I5) ^re divided by 2. 

X. . 

writing y^^ = for i = 1,2,3 

& j = 1,2,. . . 7 


The coefficients of the scaled LT problem are tabulated in Table 4.10* 
Writing Z in terms of _y. . and scaling it by a factor of 5000x25. 


500fe~= = *43^11 *52712 *^4713 ^ -^^^14 *^^15 *"^16 •72y^7 

+ + 7^2 *'^2y25 + *28724 ^ * 1^^726 ■^•76727 

+ .Sy^^ + .68y^2 '^*^755 + .2yj4 +-687^^ 


(4.14) 




Table 4.10} Scaled constraint coefficients for example 
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4.5*2 Analog Solution? The analog computer set up diagram for table 
4.10 and equation (4.I4) is shown in appendix ’D'. This problem utilized 
the following Analog Computer components (refer to 

(a) Amp^-ifiers = 21 + 2x10 +2 =45 

(b) Pots = 2 x 14 + 2 x 19 + 7 + 1 = 74 

(c) Diodes = 21 + 2 x 5 ~ 27 

Using the procedure outlined in 5 * 1 *5 the optimal solution obtained 
iis tabulated in table 4*11* The resul-ts obtained from IBM 7044 using UP 
package are also tabulated in the same table for comparison sake. It is 
seen that the maximun error is about 2/^ , which is quite acceptable 

4.5,5 Post-Optimal Analysis ? The effect of variation of amount available 
at each origin on the objective function was studied at discrete points and 
plotted as 0 ^, Og & 0 ^ in Pig, 4. 5. The demands (Tons/day) at each destination 
, Dg. ...By) was also varied with the help of calibrated potentiometer 
and its effect on the objective function observed. These obseiTvations are 
tabulated in table 4. 12 and the corresponding curves plotted as sho-sm in 
Fig. 4. 3. Consider the curve 0 ^ in fig.4.3, representing the quantity 
available in Tons/day at origin 1 . For optimal value of Z = I2125O, the 
availability desired at origin 1 (O^ ) is 10,000 Tons/day. It is seen from 
table 4.12 and fig.4.3 that any decrease in 0^ from this value results in 
the increase in Z, thereby implying more cost of transportation. Whereas 
Z is not affected so Img as 0 ^ and 0 ^ are greater than 1000 Tons/day and 
1500 tons/day respectively. Study of demand curves (U^ » 1*2 * reveal 
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i Variables f 

Scaled 

Analog 

Solution 

1 Analog 

y Digital 

I Percentage 
y error 

_J 

! 

S s olution 

0 

0 solution 

0 

( ' 

' ^11 

.402 

2010 

2000 

•5 

I 

i ^12 

.202 

1010 

1000 

1 

i 

i ^15 

•397 

1985 

1999 

•7 


.896 

4480 

4500 

.445 

^15 

.105 

505 

500 

1 

^16 

I 

0 

0 

0 

- 

I 

^17 

0 

0 

0 


X j 

0 

0 

0 

- 

21 




^22 

0 

0 

0 


^23 

. .190 

990 

1001 

1 .1 

^24 

0 

0 

0 

- 

) 

1 25 

0 

0 

0 


1 ^26 

0 

0 

0 


^27 

0 

0 

0 

" 

^31 

0 

0 

0 


^32 

0 

0 

0 


^53 

0 

0 

0 


^34 

0 

0 

0 



0 

0 

0 

“ 

H 

as 

.122 

610 

600 

1 .667 

X-.™ 

.186 

950 

950 

2 .1 

37 




.in..-.—. 

z 

•97 

121250 

122250 

.615 


Table 4. 11 * Comparison of analog and d iia;ita , I. sol-utioas for exam pl e , j 





2000 


3 Plot of objective function vs. re 
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that increase' in demand results in increased transportation cost and 
dccreiso in demand reduces the transportation cost. It may he observed 
that th,' ('ffcct of increase in demand D is less pronoxaiced in increasing 
the trononortation cost. 

4 .6 Dif'.cu.'ig.i on» It is seen that non-uniform scaling of the variables 
becomes (lulto involved as in example 5 while the uniform scaling may at 
times fail to achieve desired accuracy, as in example 4- is now possible 
to efj'or riumo guidelines for the scaling procedure. 

(;>,) In start ^vith, scale all the variables of the given model by the 
oaino factor as in examples 2 and 4 ^n.d comuute the results on the 
An.".lo," Computer. 

(b) In c.' :',G the magnitudes of some of the variables are too small or 
boyund the range of Analog Computer, use appropriate scale factors 
ff’r the affected variables and modify the scaled coefficients 
accordingly. Compute the solution with modified pot* settings. 

It is clear from the four examples that medium sized linear 
progra>rim.uh; problems having upto 1 5 -20 variable s/constraints can be solved 
on iinalo/^ !)omimiter with a reasonable accuracy. The solution is obtained in 
a single run m a matter of few seconds and therefore it is a reasonably 
fast method of solving LP problems. However there is one drawback. Ihen 
one of the constraint hyperplanes coincide with the hyperplane of the 
objective function, an infinite number of solutions can result. This 
situation ecu. be checked by having 2-5 runs each with different initial 
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conditions. In LP package (IM 7O44), use of "EHS EAHGIUG" & "COST 
control cards will give the lower and the upper limit fox 

!j) & (i =1,2 ...m) respectively for which the optimal 

aoluiiun bncis remain taachanged. However to observe the variation in 
objective; function with the varying parameters will involve extensive 
digital computer programming* In -ftnalog method the variations in resources 
avail 'blo or the variation in cost/profit coefficients can very easily 
b(-‘ simulahod by just resetting the relevant potentiometers. This gives 
a vciry valuable insight inta the practical problems and here the .Analog 
compute'!’ definitely has an edge over the digital computer. 
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CMPTER 7 

WOH-LIKEiJl PROaHAM/TTOg 
5 •”! &ie non-linear prosrammins' nroh' 


ar programming problem is to find x. ,x„ . . . .x 

i d n 

2 (5.1) 


Subj'.'ct to 


.raize 

Z ( 

^*1 ^ 

• • . .x^ ) 

to 





Gc^ 

y ^2 • 

• • • . X ) 

n 

*^2 

(x*| 

, ^2 • 

• * . . 2 ^) 


(5.2) 


^ — 

& 0 for i == 1 ,2 • • . • 


O' -j y 
f ^ 


x^ ) and (x^ ^Xg • 


. . • x^) are given functions of 


n d(,'(;isi(>n variables. 


5.2 Analo /; IVIo thod of colution : Bic Analog method of solving LP problems 
cm bi; extended to solve tiioso non-linear programming problems idiich are 
i.'Xirc‘£!siblc un analog ccanputcr. With slight modification writing 
equations (0.5) and (2.6) for general programming problems 


i r\x. 

'■ 1 


2h. 

^^i 


where e - *= i!) . (A. - b.) 

J tj J J 


e . for i = 1 ,2 . . 

O 


for j = 1,2 


• -n (5.5) 


(5.4) 


Term s. is introduced since in the solution of non linear programming 

9 z 

problems, sotting of pots s may be different for different • It is 


clear that to instrument a ncn-linear programming problem we must be 

^ 2 9 A j 

able to coraimte &-r-^ and hence the first derivative of Z must be 

d 
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defined throughout the solution space and the first derivative of A. must 

Cl 

bo df'finod in the neighbourhood of the boundary space (defined by strict 
equal L tics in 5.2). 

5*5 Possible types of solution; 

1 . dhn most straight forward solution occurs virhen the absolute 

jaaxii'ium or minirouni value of the objective function Z lies within the region 

npocified by the constraints on , X2 • • • . x^. In this case the constraints 

rb) not play any significant part in the solution. Ihis is only possible for 

Cl. nonlinear objective function as the very nature of this type of solution 

implion the existence of stationary points in a domain. For this tjrpe of 

3 Z 

non-linear programming problem, the conditions -=:r = 0 are satisfied and 

a^i 

iniogrtition ceases precisely "vihen the x^ give the maximum/minimum value of 
tlic- objective function. 

‘2. When the absolute maximuny4ainimum value of objective fmction 

Z lies outside the restricted region, the solution is entirely determined by 

the constraints A. ^ b - for j = 1 ,2 . . . . m. 

J w 

fhe Xj_'s will be driven in the direction of maximum/minimum value 
of Z(x) until a constraint boundary is encountered. Further motion is 
alnn/' the boundaries of the restricted region until the objective function 
is maximize d/minimized. In practice an exact solution to the problem is 
never obtained for the following reasons s 

can never be made zero since global maxima/^ninima 

lies outside the region defined by constraints. 
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(b) To make the input to the integrators as zero (for steady 
otn.to solution), an error voltage is required to cancel i.e. 

liiorc of the constraints being minutely violated. 


one or 


IHae to the characteristics of diode feed back circxiits providing 
.■11 .'unplifiod error voltage Ke. this violation in constraints is -very small 

V 

end the overall error does not exceed 1-29o. 


5 .'1 Difficulties associated with non-linear programming = 

As pointed out in chapter 2, solving nonlinear programming 
I'robloms on the analog computer present two main difficulties. 

(a) Non-linearities when described on analog computer require more 
olrtboicto oquipment in the form of multipliers, Deviders and function 

:en(jr; tor:j etc. Yjhich restrict the size of nonlinear programming problems 
th.tl; con be solved on Analog Computer. 

(b) Non linear programming problem may have a number of local 
maximum (ivliniinum) values which will ".arrant sufficient scanning of the region 
of into-rest to arrive'; at the absolute maximrim/minimum. This is illustrated 
by a simple two dimensional example. 

8.5 Example 6 ? * 

J.!!aximize Z = 25 (x.j-2) + Gc 2 “ 2 ) (5*5) 


! 


•^liadley, G., "Nonlirioar & llynamic Programming” pp 11-12. 
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Sub.ioct to 

<• 2 
+ .5x2^5 

= .333x^ - X2$ .667 (5.6) 

\ *^2 * » 

& x^ , X2 -^0 


Th(.' (f'om.ofcric^l representation is presented in Pig. 5.1. It may be seen that 
t}ii; oxtr'-'me point (2)yields the global maximum of the objective function, 
however extreme point(^yields a relative maximum of the objective function 
di.ffercnt from the global maximum. 


5 . 5 • ”1 Scaling; t 


Writing 

^i = 

' in (5.6) 

Pi 


-p^y^ + 

^2^2 

^ 2 


•5p-iyT + 

• 552^2 

^ 5 

(5.7) 


. 355 P-iy-i - '^2^2^ 
Piy, + > 2 


Dividing each constraint of (5.7) "by 5 taking p^ ■" ~ 5 » ihe scaled 

!)roblen! is recorded in table 5 .1 , Expressing the objective function in 


terms of y^ 

Z = 
Z 

1250 


25 ( 5 y^“ 2 f + ( 5 y 2 - 2 )^ 

-= Z’ = ,02 (57^-2 f + .0008(5y2--2f 


or 


(5.8) 




Fig. 5-2 Analog schematic for example 6- 



61 


Constra,intl 

I Variables 

[specif ication 

No. ( 

i 


i 

1 

-1 

1 

^ #4 

2 

•5 

•5 

.6 

i 5 

I -555 

-1 

I 

*1554 

' 4 

L. 

1 ! 

i 

1 

\V 


Table Scaled constraint coefficients 

for example 6 . 


Tlie partial derivatives of Z’ with respect to y-j & yg are 


2 « 

■ .Jl 

\ 

2 ' 


y-1 

.04 y^ - .016 


(5 =9) 


9 .5 Analofr Solntion* 

Tho scaled problem in table ^*1 and equations ( 5 - 8 ) and ( 5 >9) 
are inctr'uni'‘nte.d on tbe analog ccanputer as shown in Fig.S-S. ^o obtain the 
rqitimian solution of nonlinear programming problems, procedure outlined 
in stop 5 of 3.1.5 is slightly modified while setting the varioua s 
pots. Ifelike in LP problem solution, where there is only one s pot, 
ooJution of nonlinear programming problem on the analog computer may 

involve n number of s. pots to be set individually. The pots s. may be 

X 


oot in the following steps. 
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1 . Initially keep the setting of all pots as unity and put the 


nji.-'.log computer from "Reset" to "operate" 


2 . Vary a^^at the same time observe 


dz 


3yi 


. Ihe desired setting of pot 


ic th(; one that gives minimum value of , Hovrever in certain cases 

^ 3y-i 


3 z 


:'.f tiing of the pot. may affect other 

o y 


in. that case all such 


Z 

.3 y. 


siiould also be observed for a minimum value. 


5. 3 t*.‘P 2 is repeated for setting of other s^ (i = 2,5 ....n) pots. 

ihus several computer runs were made using modified procedure 
.■iUfl vith (1 i ffcT'ont sets of initial conditions. It v/as observed that whenever 
tiic' stf. rting point v;as in region h (fig. 5 * 0 , the local maxima point(^was 
cbt,;:. in<.'d but y/ith the starting point in region B, the global maxima point 
0 v;as arrived at. The solution obtained with starting point in region A is 


= .401 X 5 ~ 2.005 

=^2 = 0 

wliOreos the solution obtained with starting point in Region B is 

= .995 X 5 = 4*975 

Xg = *201 X 5 = 

i..'hich is the global maxima for this problem. 


5.6 Convexity and conoavityf 

It is at times worthwhile to test for the conyexity/concavity 
of the objective function and of the constraints of the non-linear 
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prof!:rammiag problem. For the cases detailed below the local optimum 

point io also tho global optimum point and hence no scanning of solution 
■'•.pticf is necessary. 

(a) A maximization problem Tirhere the objective function is concave 
and the ccnstraints are concave/lineon. 

(b) In a minimization problem when the objective- function is convex and 
tho constraints arc convex/linear. hr appendix *H’ the necessary and 
sufficient conditions for convexity/concavity are explained and a 
general scheme for assessing the convexity/concavity of functions 

of ijiore than one variables is given with example . Three typical 
non linear programming problems that \fere solved on the TR-20 will 
bo discussed now. 

5*7 %aniplo 7'*^-. (quadratic progranming) 


•Quadratic programming problems are special class of non-linear 
i;x-ogranming problems in which the constraints are all linear but the 
{..bjoctivo function in of the quadratic form. 


Maximize Z = {l2.1-x^)x^ + (8.4-2X2 )3rr, (11 .2-2xj)x^ 


Sul)ject to 5 


+ (7-7-^4)x^ + (l0.4-x^)x^ 


7.lx^ + 6 . 2 x 2 + 5.2xj + 6.5x^ + 7*4x^ 
5 .7x^ + 6 . 5 X 2 + 6 .8xj + 5x:^ + 6 
2 .2x^ + 2 . 5 X 2 + 5xj + 3 *5x^ + 1 .3x^ 


^ 20 
20 

^ 25 


(5»8) 


(5«9) 


*■ Vajda, "Readings in. Ifethematical programming" pp II7 
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5.7*1 ScalinfTi 

X • 

Dividing ( 5 . 9 ) by 10 and writing y. = 

the oculed ccaastraints are tabulated In table 5.2 


Constraint 

T^o. 

— 



Variables 

fZTZTTTT 

|yi ; 

72 I 

^3 

I ^4 : 

^5 


1 

.71 

.62 

.52 

.65 

.74 

^ .8 

2 

.57 

.65 

.68 

.5 

.63 

.8 

5 

( 

.22 

.25 

.3 

.35 

. 15 - i 

j 

i 

I 

1 

Table 

5 .2: 

Scaled 

constraints coefficients 

i for example 7 


Writing Z from (5*8) in terms of y^ and dividing Z by 50 


vio get 

^ = Z’ = (. 605 -. 125 y^)y^ + (.42 -.2572)72 + ’5^- *257^)7^ 

+(.585-. 12574)74 + (. 52 -- 1257 J 75 
Di r r c'j 'unci; 1 1 ing Z ’ 


■■'Z’ 

X 

:s 

.605 - .25y. 

<D 7 -i 



v;)z» 


. 42 -. 25 y 2 

,->72 


)iz' 


. 56 -. 25 y 5 

3X3 


B Z’ 


.385-.25X4 

0X4"" 


c)Z' 



^X. 

s= 

,52 -.25y^ 


( 5 . 10 ) 


( 5 . 11 ) 
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5 •7*2 Ana Ing Sol-gtion? 

The Analog Computer diagram to Instrument the scaled problem 
rcprcGontcd by tnblo 5*2 and equations ( 5 * 10 ) and (5«1l) is shown in Pig. 
5 . 5 . Modified procedure as outlined in 5 - 5 . 2 was followed and the results 
obtained arc tabulated in table 5 *3 « Digital computer results are also 
tabulated alongwith for comparison. 


Variables I 

J 

Scaled 

solution 

j" Analog 
j solution 

I Digital solution 

J Error 


.593 

1 .4625 

” 

1.47 

! 

.855^ 

Xg 

.043 

.1075 

.10 

i 

7 •5/° 

X 5 

I 

.456 

1.14 

i 

; 1.13 i 

’ i 

,8Sfo 

X. 

4 

0 

0 

I 

0 ; 

j 

- 

! 

• 165 

! L 

.412 

•42 i 

i 

i-9fo 


Table 5 . 3 * Comparison of Analog & Digital solutions for example 7 

5«7*3 Effect of Varying MS elements: 

The effect of variation of EHS elements on the objective function 
vnn studied at discrete points. One element of EHS vector ms varied at a 
time with the help of calibrated potentiometer and the corresponding 
objective function values reoox-ded in table 5«4‘ The values of the variables 
mrc observed simultaneously and any changes from the basic feasible 
solution recorded in the remarks column of table 5*4* The variations 


are plotted in Pig . 5 *4 







10 V 

■' 0 — y^,,, 




Analog 


c hem a tie- for '.'e 








» i > / ' # 


2 ^ 51 r'vO ^ 
y ncr;'"?ri >-*-? 
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Table 5.4 5 Hecord of the effect of variation in b. on 

^ -T -j 

the o bjective function (z) 

It is seen from table 5.4 and Fig. 5. 4 that increase in value of 
bj does not improve the value of the objective function. Infact b^ can be 
reduced from 25 to 7.5 without affecting the value of Z. A further increase 
in bg from 20 results in a ncminal increase in the value of Z to 51 .95 


Objective function 



.V’' .y, VJ 




'mMmm 

IlliiJiiili 


spi®ip 

PI|»P 
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o.nrl it) constant thereafter with further increase in However increase 
in from 20 does result in increase of the objective function. It can 
be pointed out that any reduction in the value of b 2 from 20, 
ruoulto in reduction in the value of the objective function# 

5 *8 Ebcc:.inple 

Wo no?/ conoidcr an example in which both the objective function 
and the constraints are nonlinear. It will be seen that patching up of 
nun-linear constraints on Analog computer requires a more elaborate set 
up to catu-r for the nonlinearities in the constraints as well as in 
computing the partial derivative of 


Mintoizo Z ’ 

2 2 ? 

= + 2x^ 5x-i - 5^2 - 21xj + 7x^ 

( 542 ) 

subject to 




2,22,2 


* "^3 ==4 ■" ==1 - ^ ==4 ® 

( 545 ) 


“ 2x,|^+X2^ + x^^+2x^“X2 - x^ ^5 



5.8.1 Sea 1 toff t 

Xi 

Writing = 2 — ^ (5*15) aJii dividtog it by 20 
wo got 

.2y^^+.2y2^+.2y^^+.2y^^+.1y^ 4 

P 2 2 b.14) 

. 4 y ^ +.272 +. 27 ^ "*^^2 -•^ y 4-^‘25 

Ihe Jacobian matrix J(A,x) of set of function A(x) is defined by 


* ^’Operation Research” Vol*17»2> 1969* PPy 978 
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Hio Jacobian matrix J (A,x) of set of function A(x) is defined by 




'd A, 

dx., 

■ • 

3=Si 

7^ A 


. . '^^2 ! 

< 

r)^2 

*3^ ! 

I • * 

( j ^ 

m 

c) 


i d 

d^2 ’ ’ 



.'■nd i r, rtjqtiirod to bo computed in the feed back circuits of programming 
prublomo having nonlinear constraints. For this problem from (5.14) 


I .4x.+1 .4x„~.1 .4x,+1 

j(A,x) - I ^ ^ 

j .8x^ + .2 .4x2-* 1 

Writing Z from (5 .12) in terms of y^ and scaling it, wc get 



^ » Z’ fa .08y^^+.l6y2^+*08y^^“.2y^-'.2y2-.84y5+.28y^ 


Differentiating Z* 

371 .iCyi .2 
^Z' ^ 2 

3^2 

c) 7, « 

^ ** “■•84 

5 

dzt 

.or fa .167. + *28 


(5.16) 


(5.17) 
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^•Q -2 imaloK Solution* llio iaaalog ccmputer diagram instrumenting the 
scaled prohlom reprosonted hy relations (5.I4), (5 .15) & (5.I7) is shown 
in Fig. 5 * 5 * Ihis problem utilized 4O amplifiers with seven multipiiers, 
four cciuarurc and 38 potentiometers. The optimum point was obtained by 
using mtdifiod procedure outlined in 5*5*2 and the results are tabulated 
in table 5.5 alongwith the digital computer results. 


Variable G 

i 

Scaled H 
Analog A 
solution jj 

Analog 
s olution 

I Digital 
^ solution ^ 

J L 

—I 

Error 


0 

0 

0 


- 

""a 

.515 

1 .05 

1 




1 .00 

2 .00 

2 


Uil 

^4 

-*494 

-.980 

-1 


1 

I ^ 

• 

-44.8 

-44 


1 -&J % 

Lp***., 

Table 5.5* 

Hi R on of Analo/? & dteital solutions for Gxagiple^^ 


5.8.3 Effect of Varying RIIS Elements ; The effect of vrriation of HHS 
vector i.n the objective function was studioc’ at discrete points with the 
help of calibrated potentiometers and the corresponding values of the 
objective function rooorded in table 5 * 6 * Eemarka column of table 5*6 
indicate any changes that occur in the basic feasible solution. These 
variations are plotted in Flg.5.6. In Eig. 5 * 6 , negative of the objective 
function is plotted against and bgf because the optimum value of Z is in 

the negative range. It can be seen that the value of the objective function 





Fig.5>5 Analog computer set-up for examples* 
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b^ I Z I Eomarks i 

^9 ^ 1 Remarks 

2 -10.175 

0 -29.7 

3.8 - 55-85 > 0 

2 -35.9 

4 “ 44*25 >0 

4 “ 42-5 

■ 6 - 44-75 

5 “ 44 -8 Optimal 

0 -44-8 Optimal 

6 -47.1 

10 -44.75 

7 -49.25 

12 -44.7 

7*5 “ 49*9 

14 -44-^ 

8 “50-5 x^>0 

; 16 - 44*5 



Table 5.61 Eecord of the effect of the variation, in 
h. 0“1,2) on the objective fxmction (z) 

« -il ...... I - 

can bo oi^?xificantly reduced by furtber increasing the value of b2 from 
5f vdK;rcn3 an incroaso/decrease in b.^ from 8 increases the valiae of the 
i.b.jcctivo frinotinn. 

r, Optimum Generator Allocation t This problem forms part of load flow 
studios of poT/jer networks. The total amount of real power in the network 
emanates from the generators, the location and size of which are fixed. 

The genera tin must equal the demand plus the losses at each instant and 
this generated power must be divided between the generators in a unique 
ratio in order tu achieve most economic operation. The optimality criteria 

in terms of transmission losses, both of which 


may b© in terms of cost or 












• ■'«. s.'-i'-i?, 
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can be expressed with, fair accuracy in terms of real power generation. 

It is always necessary to keep the voltage levels of certain buses at 
close tolerances, which is achieved by proper scheduling of reactive 
powers. The reactive generation in general does not have significant 
influence on the cost or transmission losses because they are controlled 
by varying the field excitation. Thus excluding the reactive powers and 
associated voltage profile from our nonlinear programming problem we can 
state the nonlinear onstraint that must be satisfied at all the times 

^ 5 . 18 ) 

i=1 


whore 

n 

’V “ Total real power generation at 'n* generating stations 

i=>1 

m 

P » « Total real power demand from m loads. 

i“1 


P_ o Total real power Transmission losses. 

L 

TVicne transmission losses can be expressed in terms of generated powers 

by Tr^iisniission^loss formula 


i.c ** A 

1 5 


P. B. . P. 
11-0 0 


where 



source loadings 

Tran8mission“los3 formula coeffieients 
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5*10 Ebcf^niplo 9* ' Wo consider a 5 b'ls prolDlein as sho-wn in Jig. 5 .7* 

86M/ 

Iho reactive pcjwcr and associated 




\ 


voltage profile is fiX'e*! for each bus.V 
The real power demand at each bus is 
indicated in Fig, 5.?. it is reqiiired 
to find generations , P2 & P^ in order v5.' 
t" minimiKu tw-insmission losses. The 
loss coefficients for the system are 
aeonmod tt' be known. 


— ft- 


/ 


1 'i 




-■f r2^ 

V — 


46.8 MW 


I7.4MW 


--3 — 

F ’ ® ® 


i ^ 

56.2MW 


^^5 



Pig .5 .7 * Beal power demand at 3 busses 
Tdio transmission looses expressed in terms of loss co-efficient 


formula arci 


\ « P^^ P-jl + '^2 ®22 ®55 ^^ 1 ^ 2'®12 . 

(5»19) 


vrhore 

E11 

.02725 


®22 

.0309 


B ®* 

35 

.523 

^21 " 

^12 ■ ■ 

.0055 

^51 ” 

’b ■ ■ 

.036c 

®32 “ 

' "23 ■- 

.00565 


(5*20) 


All powers arc 


expressed as p.u. 


taking 200 MW as base power. 


*Kirclmaycr, L.K, Economic operation of power system, pp.118. 
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1 


Analogy Solution f The problem can be expressed as:- 

Minimize Z » .02725?^^ + + .525^^^ 

- *007 ^-^^2 ■* " .073^ P ^?^ (5 -21) 

subject to the constraint 

A « P^+Pg+P^ - (.43+.234+.I8I+.O87) “ .02725?^^ 


- .0309?/ 

- .325^^^ + .007 P^p2+.0115p2Pj+.0736P5p^ = 0 

(5-22) 

Wo write 



Z 

■:)Pi 

. 0545 P^ - .OO7P2 -.O756P5 


0 z 

■ 

.O6I8P2 - .007?^ - .0113PJ 

(5-23) 

fl 

.646P5 - .011 5^2 “ = 0756 P^ 


Also A 

I-.O545 P^ + .007 P2 + .0756?^ 


^^2 - 

1-.0618 P2 + .007 P^ + .0113 Pj 

i 5 » 24 ; 

^ i . 

73^-3 

I-.646 P^ + .0113 P2 + .0736P^ 



a?ho Analof; conputcr cet up for this problem is stcim in Pig. 5 . 8 . 

This problem utilised 26 amplifiers with 6 multipliers 5 squarers and 52 
pots. The optimum solution was obtained by using modified procedure 
outlined in 5.5.2. The result obtained are tabulated in table 5*7 alo^ig 
with the digital computer results. 




Fig-5*8 Analog schematic for example 9 
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1 i 

Variables ! 

p Scaled I 
j Analog ) 
1 s olutinn | 

1 Analog 1 

1 solution 1 

1 Digital 1 

) solution 


.67 

154 MW 

144 MW 


,12 

24 MW 

10.668 MW 


.157 

51 4 MW 

54.6 MW 

t 

Table 5 

.7* Comparison of Analog & Digital solutions 
for example 9- 


O?otal optimm generated power =■ P^+P^+P^ = 189 .4 W 

Total Demand «= I86.4 M77 

Honcc Total Losses •. 189 .4-1 86.4 « 5 MW 

^Viuoruas, as calculated from objective function (5.21), Pj^ = 2.62 MW, 

Tide discrepancy in is attributed to the small 'error voltage * that 

i^ccur in the solution of ^alog Computer. Since the total demand P^ 

varies with timo> this aspect can be taken care of by varying the 

i)riato pot. setting and observing the new optimum solution. Thus 

plot can bo made of P.'s for different values of loads, 

1 

5.11 Discussion * It is clear from the examples that nonlinear programming 

problems vhioh are expressible with the available analog computer 

components » c.on be solved on analog computer with ease. The size of 

that 

non linear programming prohlem^an be solved on analog computer is 
restricted by the available nonlinear components e.g. multipliers, 
dividers and functicn generators etc. Some of the nonlinear programming 
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pri'bli.i;>s may nuod sufficient scamiing of the solution space to 
r'.rrivo at the global optimum. In certain cases the test for convexity- 
concavity (loos uliminato the scanning process. A logrithmic function 
gunor'i,t'ir asoomblcd from the data given in "Maintenance Manual for 
TR-20". HiO' details are given in appendix *5'.' 
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CHAPIER - VI 


6.1 The inalo/j; crmputer method described in the previous chapter can be 
used in solving a variety of optimization j.roblems that occur in many 
industries. The use of this analog methch with slight modifications can 
fllou be extended in selving 

(a) Simultaneous algebraic equations 

(b) Matrix inversion problems 

6.2 Simultaneous Aln'cbraic Equations? 

A set of simultaneous algebraic equations can be written as, 

Xi + ai2 ^2 ^'In ^n * 

agi + a22 Xr “ ^2 


^1 =^2 ^2 


Xn + • 




T;hich may bo expressed in matrix foim as 
AX » B 

(6.2) have a solution, the deteminaatj ^ jmust be non- 


(6.2) 


In order that 
v.-miohing 


For solution of ( 6 . 1 ) on the analog computer, the set of equations 
.0 first transformed into a set of differential equations as 


a^-| + a ^2 ^2 * * * * 

^21 "^22 =^2 "'’**• 


* ^ 1 n ^ “ "’^1 

• ^ 2 n ^ ^2 


i 

- Xu 


« - Xr 


■ (6.3) 


n 1 ^1 ^ ^ 


4 * • 


®lnn ^ 
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Ihe liJS of each equation of (6.3) represent the input to 
an intofjrator having one of the unknomis X2 ...... x^ as its output. 

Uie use of integrators would ensure that all residual errors due to the 
method of analog computer set up would be zero. This reduces to the 
original set of equations when all derivatives are zero. The matrix 
Operation being performed is 

■ A + si ! X *> B (6.4) 

The Analog Computer is being used to solve a set of n simiiLtaneous 
differential equations. The stsnt^' state solution of which (if it exists) 
will bo the solution of original set of algebraic eqi;ations. The 4nalog 
Coffii^utor set up ia then a dynamic system described by (6.4)? the 
stability nf which may be determined by finding the roots of the 
characteristic equation. 

dot ! A + si I a 0 (6.4a) 

u 

The dynamic syBtem described by (6.4) will be stable only if all the 
roots 8^j 82.. ■ . of (6.4a) have negative real parts i.e. if matrix 
A is positive definite. 

6.2.1 Analog sot up* 

If A is a nonsingular square matrix of order n, then C = A A is 
always positive definite* . Therefore the concept of premultiplying by 
the transpose of A always lead to a stable computer system j if a solution 
exists. Therefore expression (6.2) becomes 


* Hausner, A. "Analog & Analog/hybrid computer programming, 
Theorem 11.8 pp. 522. 
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T T 

A A Z » A-^ B 


( 6 . 5 ) 


This cot is then transforned as in expression ( 6 . 3 ) into a set of 
simultaneous differential eciuatione 

X - A^B « -X (6.6) 


The computer set up corresponding to expression 
since all roots of the characteristic equation 


(6.6) is always stable 


A A + si 


ire 


real negative (the matrix A^A is positive definite). Using analog computer 


one can proceed in two different ways, 

T T 

(a) Calculate the new matrix A and the column vector A B and set up 
the set (6.6) on the computer. This will require only n integrator for the 
sot up. 5'or sets having a large number of unkaowns, a considerable amount 
of calculation has to be carried out before starting the proper solution 

on the computer. 

(b) Iho multiplication of A"^ can be performed on the Analog computer 


by solving 'two sots of equations 
AK - B = e 


(6 .7a) 


A'^e 



( 6 . 7 b) 


which arc equivalent to the original set (6.6). A general set up diagram 
for orprassims (6.7a) S. (6.71.) la aho« ir Pig.6.l(a) and (b) resjeotlvely. 
Jil order that the error voltages are very nearly rsduoed to j.ero. they 
oro multiplied hy largo constant K (usually 10 or 100) hefore being fed bach 
to the Integrators. The Analog Computer set of ag.6.1 differs from 
5ig.2.1 In the following respect. 
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Kartial diagram for general method of solving 
slmnltaneous algebraic eqnations 


(a) Diodes are not used in Pig. 6.1 

(b) Partial derivative of objective fxinctionC 
from Pig. 6.1 for obvious reasons. 


'dz N 


is omitted 


6 .2 .2 Iin proving Accuracy* 

If mere acc^lrate results are desired than obtainable with Analog 
Cfjnputor sot up of Pig. 6.1, an iterative procedure may be used to improve 
accuracy. let the values of Xjj^'s obtained by computer be represented by 
CL'lumn matrix X' and let the error be represented by column matrix E, 

Klien the correct result is 


X « X‘ +E 

and the matrix operation desired is 


i #e . 


AX » B 

A |x' +E 


B 


or AE 


B - AX‘ 


( 6 . 8 ) 
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Thus v'ith the values of X' obtained from the computer set 


column matrix 


B - IX’ 


can be calculated and the values 


up, the new 
of these 


elements substituted for the EHS coefficients B in the same computer 
set up. The corrected values of column vector X are then obtained by 
addin/'; the newly computed value of error vector B. -h simple example will 
illustrate the analog method. 


Example 


Solve 


+ 10 Xg + Xj 

sa 

10 

2x.| + 20 Xj + 

tot 

10 

5x2 + 50 x^ + 5 xg 

BS 

0 

1 Qx.| + Xg - Xg 

ms 

5 

2x4 - 2x^ + 2Qicg 

= 

5 

Xj + I0x^ “ X5 

rst 

0 


To scale it, each ec^uation of 6.9 is divided by such a 
so as to make all the ooemoiemts less than or equal to 
unity. Those scaled equations from ( 6 . 9 ) are written in the 

mntrix form as follows* 
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.1 

1 

.1 

0 

0 

0" 


^1 

r 1 ' 

,1 

0 ■ 

1 

.1 

0 

0 



! .5 

0 

.1 

0 

0 

1 

.1 



I ° 

1 1 

\ 

.1 

0 

0 

0 

i 

-.1 I 

i 

I 

^4 

i 

! “ i *5 

0 

I 

0 

0 

.1 

-.1 

I 

1 I 

j 

j 

[ I 

I Xf. 

I 5 

! 

I i *25 I 

i 0 

L 

0 

.1 

1 

-.1 

i 

0 

_J 

: 

I 

L ^ ^ 

i I 

I ^ 0 

l L, 


The sealed computer diagram corresponding to (6.10) is shoTin 
in Fig. (6.2). With the first solution vector for K =« 100, vector 
\y ” calculated and the error vector obtained in the second 

run. The corrected results are tabulated in table 6.1. The digital 
comi'Uter result are also tabulated for comparison sake. 


Variables 

)\ Analog solution corrected 

1 by one iteration 

1 Digital solution 

s 

Xi 

.452 + .0005 

« .4525 

.45335 

Xg 

.911-. 0005 

» .9105 

.9IC7I 


.46I-.OO2 

“ .459 

.45954 

^4 

-.05 -.006 

a —.056 

-.05750 

^5 

-.101 -.012 

= -.115. 

-.11549 

^6 

.2495“*0065 

“ .243 

.24420 


Table 6.1 s Gumparison of analog & digital solution 
for example 10 
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6*5 Matrix Invorsi^'nt 

Matrix inversion on inalog Computer can be accomplished in the 

same way as the set of simultaneous algebraic eouations o,rc solved. 

“1 

Elements of A are computed from 

Air"" » I (6.11) 


Aot A =* E then 6.11 becemes 



a^2 • » • 

* • ®1n 

^ 1 

^11 

^12 * * 

* 

• 



t 

1 

i 

0 . . . 0 I 

s 

^21 

^•22 * * * 

• * •^2n 

1 

j 

kgi 

1=22 . . 

* * ^n 

r I 

0 

• 

* 

0 

• 1 

» • • « 

• « * 

j 


• 

f « 


€= ! 

• 


'\l1 

w 

a^2 • * • 

• « « 8* 1 

nn : 


n1 

k A . . 

n2 

« • k . 

nn 

J 

1 

1 


0 , , . . 1 


’.'hich C'Tn be written as nxn linear algebraic equations. The first 
n equations are 

^11 ^11 ^12 ^1 + * • • • • ^in^l 

®21 ^11 ^22 ^1 • • • • ®- 2 n ^ n 1 

• #• * * • * « • * * 

a^^ k^1 + a^2 ®nn \l * 

Sot (6.12) when solved on analog computer as described in secticn 6.2 
will solve for the first column of matrix E,. Other columns of matrix E 
can oaa.ily be computodj one at a time, from the same analog computer set 
up of (6.12) by proper substitution of unity elements on EHS. Thus in 
n runs inverse of the matrix A can be computed. 


»= 1 

- 0 (6.12) 
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6.4 Dr'ocusBioni 

Aaalog solution, of simultaneous algebraic eq^uations is 
advantageous in cases T;jhere there are several sets to he solved with 
t?io oame matrix. Uio Analog Computer components required for this set 
up are 

(a) Amplifiers •= Jn + m 
(h) Potentiometer “ 2g + h 

whore iji “ number of rows plus columns containing negative coefficients 
n ~ numhor f'f rariables in the pcohlem 
g «Eron zero elements of matrix A. 
h “ Non zero elements of column vector B. 

With jne-per scaling, a largo number of elements of matrix A can be made 
ijaity thereby reducing the number of potentiometers required for the 
,0('t ujj, which otherwise limit the size of the problem set that can be 
:;f Ivo.'i <n analog computer. The use of external equipnent for additional 
iiiiuts and additional coefficients potentiometers designed in Chapter II 
ant’ prr’X)r scaling can easily result in the solution of problem with 10 


variables ur so. 



GHAPTES ?II 


CONCLTJSIOU t 

A simple, fast and reasonaPlj accurPte me-tliod of solving 
medium sized Linear & Non-linear Programming problems nsing the Analog 
oompnters TR-20 has been described in detail alongvith a number of 
illustrations. Olie main limitation of this general purpose Analog computer 
in solving programming problems, is the limited number of available 
potentiometers and the availability of restricted number of inputs to each 
amj.lifiur. Biis has been partially overcome by the use of an external 
oquiimont, designed from the indigenous components to allow variable banks 
of sixty additional inputs of gain 1 and gain 10, alongwith sixty additional 
potcntiomc'ters . Uie time required in setting these external potentiometers 
erm bo cut down by the use of "single press, double throw" switches. Ibis 
prose button switch can be connected in such a way that, in its normal 
condition, the input is connected to the external pot, ihich gets disconnects 
on pressing the switch and instead -10V is applied to the potentiometer 
to facilitate the pot. setting. 

An important aspect in obtaining the analog computer solution, 
is the scaling procedure, which has also been described for linear and 
non-linear programming problems. 

For linear programming problems and some of the non-linear 
programming problems, the Analog is quickly obtained In a single 

run, in a matter of few seconds. However, sitfficient scanning of the 
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solution space to find glotal optima is nescesitated for a large number 
of non-linear programming problems, lidiich too can be carried out in a 
relatively short time. 

In the Inalog Computt,r mothud dc-ocribei, the effects of 
variation of model parameters on tlie objective function are readily observed 
by adjusting the relevant coefficient potentiometer. Ihus one can very 
conveniently explore the sensitivity of the solution as a function of 
syotom parameters and/or observe the effects of changes predicted for 
future on the system itself. This gives a very valuable insight into the 
practical prtigramming problems and here the Analog Computer define tely has 
on edge over the digital computer, 

Analog computers have been pushed into the background with 
the advent of digital computers. However, digital computers, at times, are 
nc-t easily available and readily accessible . Moreover the cost associated 
v/ith thti use of digital •pmputer is q.uite exhorbitant. Analog computer 
on the other hand, is not so expensive and its flexibility combined with 
ease of programming provide theoretical-cum-experimental approach to gain 
a real insi/jht into tho behaviour of the system under study. Therefore 
with limited accuracy as its limitation, it can prove to be very useful 
in obtaining a first order solution to be refined later on, 

A further study of other optimization techniques given out 
in ( 4 )* and (6)* using Analog/hybrid computer would motivate the design of 
more cqtdpsent to further enhance the capabilities of available TH-20. 


’•^Bibliogr^iphic^l references# 
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APEENDIZ 'E' 


TESTING POH CONVEXITY-CONCAVITY 


A function of one variable f (Xj is a convor x'unction if 
for each pair cf values of X, say X' & X” 

f [>r'+(i-A )x’j < >f(x") + (i ->)f(x») (i) 

where 0 1 

It is strictly convex if the strict inequality holds in (1 ) 
If < in (l) is replaced by ^ , then f(x) is a concave function. Again 
fcr liie strict Inequality the function is strictly concave. Eig.11.1 
shows a convex function. f(x) 

t 

ijf.S f(x')] is a point on j £.(xt») 

the curve and | X” , f (X” )] is ! K~ - 

another point on the curve both 

; f which are connected by straight ! j ! 

__j j 

Jine shown dashed. Ihe expression 0 i jp 

|9\X'*+(1-A )x', Af(x")+(1-^ )f(x‘)j Pi^.E.U Convex function 
represents -Hie points on the dashed 

lino between points |^X’, f(X')j and j^X", f(x'')j , 1. ^us 

all the line segment connecting the two points lie atovs the curve 

of f(x). A convex function is always bending upward. A concave 

function always bends down word as shown in Pig.B.2. 
f(Xf) 

f(X") 




(X) 



X 


O' x» x** 

Eig.E,24 Concave Function. 
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n variable fmctlon? 

To assess convexity-concavity of a function of n variables 

^(^'] » ^2 • • • WG define the determinant rf the matrix of second 

order partial derivatives 









d^f 


. . . 2-'f 

dx^dx 

Ox ^ 

1 ^^2 


d^f 


'J2f 


3x^33!, 

3x2 

n i 


The principal minors of the matrix of second order partial derivative are 
then identified ass 



. C)2f 







i02f 

32 ;. 


I 'piy 2 

I 

3X;3x2 

'c)x^0Xj 


32f 

^ ^f 


3X2' 




S ^f 

3 xj 33 t, 

9X53X5 



^ 2f 

dh 


3 Xi,}X 2 

0^f 



^^2 


n 
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The fttnction in convex if > 0 ,^^2 > 0 • . . 

The function is concave if <1 0 j'^2 ^ ^ » ^^5 

(i . 0 . ridd minors are ^ 0 & the even minors are o) 


Examnle * 


f » + 2 X 2 ^ + X^^ + X^Xg - 2X^ - 7X^ +12 


rJf 


c) 

^f 






= 2X^ + X^ -7 


4 X 2 


+ X. 


^f 


= 2 


^2, 


'2)x, 


>3 


0 


2X^ - 2 j 


9 












d ^2)^ 


^ 2 
O 


7)X2Z.Xi 


1 i 


N p 
CJ‘^f 


7) ^1)^ 

Hence > 


2 

1 


1 

4 

0 


9 




0 

0 


^ 0 . . . 
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®ius =» 2 > 0 “ 




5 


16 +• 0 + 0 - ( 0 + 0 - 42 ) 


2 1 
1 4 


8-1 » 7 >0 


14 ^ 0 and therefore 


fTjnction f is convex 

Assessing cnvexity-concavity for function of degree two is a 
siaple matter regardless of number of variables. Per functions of degree 
higher than two, the determinant of the matrix of second order partial 
derivatives, expanded by principal minors, may yield as many inequalities 
as there are variables. I&ider these conditions, specifying the domain of 
the variables for -which convexity - concavity can be assumed becomes 
rather involved. 
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APEB]g)IX 

ASSEMBLY OF A LOGARIIHMIC DIODE EDUCTION GSNER/LTOR 


Principle t 

Use of diodes as switching elements in straight-line-segment 
function generation has heen found to he quite satisfactory. Any 


function of a monotonio nature can be generated by biased diode networks 
placed in a parallel configuration in the input network of an amplifier 



Eig.F.2* Hot of monotonic function 

The resistor values of the network can be chosen so that the biased 
diode networks 0, © &.© eontribute the segments A,B & G as shown in 
Eig.P.2* IhGn \ is zero, all* the three diodes are forward biased and 



cond'ucting. Therefore the input impedance to the amplifier is the 
parallel combination of the throe branch impedances, giving the slope of 


segment 1 in Pig.F.2. As the input voltage 3. is made more and more 
positive, the diodes got cut off, one at a time. Sverytime a diode 
gets cut off, tlie equivalent input impedance of the amplifier is 
increased, thereby decreasing the slope of the generated function. Thus 
Log X function, which has a decreasing slope as the input voltage X 
increases, can be generated from such a network. 

Logarithmic function Q-enerator« 

The assembled LOG X Diode function generator utilises a DC amplific 
to produce an output voltage that is proportional to the logrithm of input 
signal vltago X. The output of this function generator is formed by seven 
straight-line voltage segments that closely approximate a logrithmic 
curve for a single polarity input voltage. Two inda pendent logarithmic 
function generators Tjnexc assembled. One generator accepts a positive 
input voltage X and produces a negative output voltage I = -5 log^Q 10 X. 
The second generator accepts a negative input voltage X and produces a 
positive output voltage I » log^O 10X. The circuit diagram of the 
two logarithmic function generator is shown in Fig.P.5^ Terminals S & 0 
of Log X DEG are connected to terminals B & 0 respeotiArely of a DC 
amplifier of TE-20 Analog computer. The feedback element for the 
amplifier is a stable 5^ resistor. The remaining biased diode network 
constitutes the input impedance to the amplifier. For the positive 
input DFG, as the input voltage X is near zero, all diodes are conducting 


*TE-20 Maintenance Ifenual, Drawing 10.0016155 OS 






i-Jilrmoe the amplifiers and check that the reference voltages of 
± 10 volts are within specifications. 



Adj.' 
So. ! 

i 

input voltage 

L_ 

1 Adjust 1 

1 1 

Output voltage 
^0 


1 

+ 2.15 

®19 

-.28 + .01 


2 

+ 5*25 

5 

-1.18 +.01 

Nogo,tive output 

5 

+ 6.92 

'‘4 

-2.47 ±-01 

DPO 

4 

+ 8.13 


-4.28 +.ni 


5 

+ 9*05 

H2 

-6.51 +.01 


6 

+ 9.79 


-9.15 + .01 


1 

-2.15 

^2 

+.2e+.oi 


2 

“5*23 


+1.18+.01 

Pool live output 

5 

‘-6.92 

®41 

■i2.47+.01 

DPG 

4. 

-8,13 

«40 

+4 .28+. 01 


5* 

-9.05 

B59 

■f€.5l+.01 


f 

' -9.79 

®38 

+9.13+ .01 


lahle P*1i Adjustment data for loQ- X DIG 
5. Starting from Adj ITo.l 1 

Set the Input voltage (V^) by means of pot.l as giron in 
tablo P.1 and observe the output voltage Tq. in cose the output voltage 
is cut of tolerance, adjust the appropriate variable resistor as given 
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•under '.u'l’umn "Adjust". Sie adjustments must be completed in order 
from adjus'tment no.1 to 6 and after each adjus-fcment, -fche previous 
adju,Gtmont must be ohecked. 

For example "bo adj'ust the positive output DPG set to 
-2.15 volts -with coefficient potentiometer 1. Adjust '^o 

+.28 volts. Set to -5.25 volts; adjust R^2 '^0 “^^sures + 1.18 

volts. P-Gchock adjus’tment number 1 and reset ^22 necessary. Hecheok 

adjustment 2 and reset if necessary. Set adjus'tment 5? reoheck adjustments 

\ 

1 & 2. The recheck procedure is necessary only for adji^stments 1,2 ec 5* 
Adjustments 4»5 6 can be made ind9pendently. 

Results t 

The output voltage raiage of Log X BFG- is 0 to 10 for an input 
voltage range of 0.1Y to 107. From 0.17 to 1 7 input, the output is 
within 2$^ accuracy. UShereas from 17 to 107 input, the output is -siirell 
within .55^ accuracy. In ag.5*5 solid line represents the desired 

the X marks represent the actual output of the BPG. 


LOG X curve , whereas 




